Similar impact of topological and dynamic noise 
on complex patterns 

Carsten ManEI and Marc-Thorsten Hiitt 

Bioinformatics Group, Department of Biology, 
Darmstadt University of Technology, 64287 Darmstadt, Germany 
(Dated: February 2, 2008) 

Abstract 

Shortcuts in a regular architecture affect the information transport through the system due to the se- 
vere decrease in average path length. A fundamental new perspective in terms of pattern formation is the 
destabilizing effect of topological perturbations by processing distant uncorrelated information, similarly to 
stochastic noise. We study the functional coincidence of rewiring and noisy communication on patterns of 
binary cellular automata. 
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FIG. 1: Comparison of a synchronous (top) and a Monte Carlo (bottom) update scheme of the dynamics 
on a regular graph with d = 10 and = 200 for 400 time steps. A large k favors stationary behavior 
while small k values lead to an oscillatory and chaotic domain respectively. Complex Patterns emerge in 
both cases for intermediate values of the parameter k. Here and in all following figures time runs in each 
spatiotemporal pattern downwards while the nodes are lined up horizontally according to their positions in 
the unperturbed regular network. 

Within the last two years cellular automata (CA) have re-emerged in the focus of scientific 
attention, both with respect to fundamental work lUllj] and with respect to applications, e.g., to bi- 
ology lIslH,^]. Such CA play an important role as minimal models of complex pattern formation. 
Pattern complexity is usually discussed in terms of the four Wolfram classes [6] distinguishing 
fixed points, periodic, chaotic and long-range complex behavior, respectively. Recently this ap- 
proach to pattern formation has been linked with concepts from graph theory by studying the 
behavior of CA under variation of the underlying topology [vHsl]. Investigations elucidating the 
link between dynamics and topology in complex networks are needed to ultimately understand 
the evolutionary building principles of biological networks. The incorporation of noise or dis- 
order in such systems is a natural step towards realistic models |8, 9]. Qualitatively speaking, 
there are two possible ways of introducing disorder: On the level of signals and on the level of 
architecture. The function of shortcuts in regular graphs with local clustering, as first proposed 
in iQo'], has mostly been attributed to the dramatic decrease of path lengths in these small- world 
networks. In addition, however, topological perturbations can distribute global information among 
the local neighborhoods. Recently, simple binary dynamics in a noisy environmenrproved to be 
an excellent example for efficient information processing in decentralized systems |8]. 

In this paper, we compare the two types of disorder in a model system of complex pattern 
formation, namely a totalistic CA generalized to arbitrary system topologies. We show that topo- 
logical disorder, while retaining determinism of the time development, produces qualitatively the 
same effect on complex patterns as stochastic (external) noise by inserting uncorrected infor- 
mation into neighborhood-based local patterns. We argue that this mechanism is responsible for 
the possibility to pass from one Wolfram class to another purely by topological modifications of 
the underlying graph that has been recently observed in [7]. We show that this relation between 
topological and dynamic noise remains, even when one skips to a Monte Carlo update scheme. 

We consider a simple binary dynamic ^{k) presented in |l7|] which is capable of generating 
complex behavior on a standard CA topology, i.e. a regular one-dimensional graph with periodic 
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FIG. 2: Spatiotemporal patterns for different degrees of topological and dynamic noise. Both sets of patterns 
are generated by a synchronous update of rule Q{k, = 0.35) on a directed graph with 200 nodes and d = W 
for 400 time steps. They show a decrease of long-range correlations with increasing noise intensity rj. For 
topological perturbations (top) the noise intensity t] specifies the fraction of rewired links. In the context 
of input noise (bottom), t] gives the probability for a neighbor being replaced by a random binary number 
during the update process. Visually, both noise mechanisms have the same effect on the pattern formation 
capacity of the network dynamics. 



boundary conditions and N nodes, where every node is connected to its d nearest neighbors. The 
state Xi G {0, 1} of a node i is flipped or retained during the update process according to the 
parameter k and the density pi of I's in the node's neighborhood, Pi = j: J2j ^ij^jii)^ where di is 
the degree of node i and Ay is the adjacency matrix of the underlying graph: 

(Xi{t) , Pi< K 

Q{k): x,{t + l) = \ (1) 

[1 - Xi{t) , Pi> K . 

The dynamic regimes for random initial conditions are intuitive: Small k favor changing nodes 
while large k lead to stationary behavior. In between these limiting regions, space time patterns 
with both oscillatory and stationary elements occur and complex dynamics can emerge. Fig. [T] 
shows the k dependent domains for a synchronous and a Monte Carlo update scheme on a regular 
graph. In the first case, the simultaneous application of ^1{k) to all nodes in one time step 
leads to strictly oscillatory behavior around small k and a narrow regime of complex patterns for 
K ~ 0.35. The Monte Carlo update of ^I(k), where in one time step randomly selected nodes 
are updated in random order, leads to chaotic patterns for small n and a larger complex region. In 
both cases, the variation of k results in a gradual change of the dynamic complexity. 

We systematically studied the effect of noise on the pattern formation capacity of a syn- 
chronously updated network according to the rules ^I(k). In the noiseless case each ^I(k) then 
corresponds to a specific deterministic CA rule number. For disordered graphs, we exploit the 
portability of to arbitrary architectures. In the following we choose a value of k giving complex 
(Wolfram Class IV) patterns for the topologically and dynamically unperturbed system. In Fig.|2l 
two sets of spatiotemporal patterns are shown as typical examples for the impact of noise on such 
CA dynamics. In the first case, the regular graph topology is altered by rewiring the endpoints of 
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FIG. 3: The word entropy 1^ as a function of the noise intensity ri for topological and dynamic noise on a 
synchronously updated network. We analyzed 10 runs of = 0.35) for 500 nodes and 50000 time steps 
where a transient period of 1000 time steps has been dropped. As in Fig. |2j the noise intensity r] specifies 
the fraction of rewired links (solid line) and the probability for the occurrence of input noise during the 
update process (dotted line) respectively. For visual clarity, data points have been joined by lines. 

randomly selected links. This procedure is similar to the one described in llioll . Here, however, it 
is applied to directed graphs. In this context, the noise intensity r] specifies the fraction of rewired 
connections. In the second case we surmise that the communication between the elements is cor- 
rupted by noise: The state Xj of a linked element j is substituted randomly with a random binary 
number with probability r) during the update of element i. We call this perturbation input noise 
throughout this paper, since it affects only the perception of the neighboring state Xj as seen by i 
in Eq. ([T]) and does not change the state of j itself. The visual impression of Fig. |2l suggests that 
input noise on the one hand and rewiring the regular graph architecture on the other affects the 
complexity of the system dynamics in a similar way. We apply the word entropy W, introduced in 
10] and tailored to the classification of CA into Wolfram classes, to quantify the pattern formation 
capacity of the noisy network dynamics. The word entropy Wi relies on the relative number of 
words, i.e. blocks of constant cell states, of different length in the time series {.Xj} of a node i. The 
overall word entropy W is the average over all N nodes of the graph. 



where pi{l) is the probability for the occurrence of a word of length / in the time series of node i. 
For the ^-dependence of W, see [7]. In Fig.|3l we show the word entropy W for systems perturbed 
by rewiring and input noise, respectively. The pattern complexity decreases in both cases similarly 
with the noise intensity rj. Note that in both cases the numerical value of the noise intensity gives 
the average number of perturbations per link and time step. 

In a second investigation we studied the same phenomenon under a Monte Carlo update 
scheme. This random time evolution is argued to be more realistic in terms of information pro- 
cessing in natural systems, as a simultaneous update may induce stable patterns as artifacts. As rj 
is increased, coherent regions in the patterns disappear and chaotic behavior prevails (Fig.©. Due 
to the change in the update scheme, a proper separation of the dynamic regimes with the word 
entropy fails: Short /-words of different lengths in the chaotic patterns result in similarly high 
W values as in the complex case with long-range correlations. In order to definitely classify the 
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FIG. 4: Spatiotemporal patterns of a randomly updated network for Q{k = 0.4) on a directed graph with 
200 nodes and d = 10. Spatial correlations vanish as r] is increased. 
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FIG. 5: The detrended fluctuation analysis (DFA) quantifies the size of fluctuations in a signal on different 
time scales. The inset shows the time series of three signals analyzed in order to illustrate the different 
correlation strengths. A pure random, white noise signal (bottom) results in a slope a of about 0.5 in the 
log-log plot of fluctuations vs. time scale. An integrated white noise signal (top), called Brownian noise 
and representing a random walk leads to an a of 1.5. The signal in between stems from the density p of a 
Monte Carlo updated automaton with k = 0.45 shown in Fig. [2 The a of 0.86 indicates the existence of 
long-range correlations, which can also be seen in the corresponding time series in between Brownian and 
white noise in the inset. 

pattern evolution with a single observable one could use the entropy measure proposed by Wol- 
fram in 10], where all possible words, including non-constant /-words, are accounted for. Instead, 
we will apply the (statistically less demanding) detrended fluctuation analysis (DFA) to reveal the 
complexity of the binary network dynamics, as applied in [9]. 

The DFA characterizes the time correlations of a signal with a single value, the scaling exponent 
a. A random signal with no long-range time correlations leads to a = 0.5, while Brownian noise 
exhibits an exponent of 1.5. Ma ny p hysiologic systems have been shown to generate signals 
with long-range time correlations Hllh resulting in an intermediate scaling exponent of a ^ 1. 
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FIG. 6: Detrended fluctuation analyses (DFA) of a Monte Carlo updated dynamics Q{k = 0.4) against the 
noise intensity rj. Both noise mechanisms have similar effects on the complexity of the time series of the 
density p of the system. Again, we used a network consisting of 500 nodes with d = W and analyzed the 
time series of 50000 time steps discarding a transient period. The error bars indicate the deviations of 10 
runs, where the random initial conditions and the graph randomizations have been varied. The time series 
in the insets show the correlation character of the analyzed signals. 



Fig. 13 shows three signals with different time correlations and the result of an applied DFA. The 
known relationship to the scaling exponent aps of the power spectrum of fluctuations, aps = 
2a — 1, allows a comprehensive discussion of parallels between complex dynamics with a = 1 
and natural phenomena with 1// fluctuations lll2ll . Detailed descriptions of the DFA algorithm 
can be found in lfl3ll . We use the DFA to measure time correlations in the overall density of 
a system p{t) = j^'^f^i Xi(t) and thereby quantify the complexity of the system's dynamics. 
Again we find that both, perturbations of the regular topology and dynamic noise affect the system 
in a intriguingly similar manner (Fig. In the extremal case of r/ = 1 (which corresponds 
to completely disintegrated neighborhoods and the permanent substitution of neighboring states 
with random binary numbers respectively) both systems exhibit a completely random, white noise 
signal, characterized by an exponent a ^ 0.5. 

How can the similarity of two such different noise mechanisms be understood? Complex dy- 
namics given, shortcuts insert information from distant regions of the network into local neigh- 
borhoods, which is — due to its lack of correlation to the neighborhood at hand and the overall 
dynamics of the network's elements — similar to random dynamic perturbations. Fig.lTJdepicts the 
two discussed noise mechanisms schematically. One prerequisite for the similar impact of both 
noise mechanisms is therefore clearly a globally running complex or chaotic dynamics, which 
ensures an adequately random and uncorrelated signal from the linked distant node. Apparently 
deviations in the space and time correlations of the noise events are leveled by the internal signal 
processing of the network. Finally, we want to note that other kinds of dynamical noise (like white 
noise affecting directly the state Xi of the system) and other forms of topological noise (e.g. the 
addition of links into the architecture) lead to similar results as the mechanisms discussed above. 

The effect described in this paper may apply to a large class of network dynamics phenomena. 
The results in |il4] for example, where the forest-fire-model is discussed on a small-world topol- 
ogy can be interpreted in this way. There, a self-organized critical state of the system is achieved 
without the introduction of dynamic noise (namely the occurrence of lightning strikes) by rewiring 
a small fraction of links. On the other hand, topological and dynamic noise can also play different 
functional roles in network dynamics, as reported in [8] for the case of a simple density classi- 
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FIG. 7: Qualitative visualization of the two noise mechanisms for a A'^ = 50, d = 4 graph and a noise 
intensity of r] = l/{dN). The schematic diagrams on the left show the result of a network dynamic, 
a spatiotemporal pattern of zeroes and ones where time runs downward and the 50 nodes are lined up 
horizontally according to their position in the unperturbed chain. In the upper picture, a simple directed 
link has been rewired and accordingly, the states of a distant node j affect the update of node i through this 
shortcut in every time step t, t + 1, t + 2, . . . . The perturbing binary elements can be lined up as a noise 
vector, consisting of the time series of element j. In contrast, for dynamic perturbations this noise vector is 
made up of random binary numbers. These affect the update process of randomly chosen states at random 
times t' , t", t'", . . . , substituting the state of a neighboring node with probability eta. 

fier task. Indeed, the globalizing effect of shortcuts and the random perturbations of input noise 
provide two very different resources for an effective processing of the majority rule. However, 
complex dynamics can be regarded as a functional state of a complex network itself, as discussed 
recently in [ 15]. As we have shown, the systematic modification of such dynamics can be equally 
achieved by dynamic noise and topological disorder. We expect that this functional alternative in 
regulating dynamic features can be found to be exploited in natural systems, as soon as one looks 
at phenomena from the perspective lined out here. 

Summarizing, we find that in graphs with clustered neighborhood structures, links between 
distant regions of the network can have the same effect as stochastic perturbations of the dynamic 
signals themselves, if the signal conferred by these shortcuts displays an appropriate degree of 
chaoticity. 
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